The literature search for the assessment corpus was conducted using search terms provided by the experts and refined in co-operation with the Knowldge and Data task force. The search was conducted using OpenAlex, scripted from R to use the API. Search terms for the following searches were defined: Transformative Change, Nature / Environment and additional search terms for individual chapters and sub-chapters To assess the quality of the corpus, sets of key-papers were selected by the experts to verify if these are in the corpus. These key-papers were selected per chapter / sub-chapter to ensure that the corpus is representative of each chapter.
The following terminology is used in this document:
Individual corpus: The corpus resulting from one search term, e.g. transformative or nature or ChX_Y
Assessment Corpus: The corpus resulting from the search terms transformative AND nature
Chapter corpus: The corpus resulting from transformative AND Nature AND ChX_Y
The following searches are conducted on Title and Abstrat only as the availability of fulltext drops in 2020. OpenAlex did “inherit” fro Microsoft Academic their initial corpus in 2021 which contained a lot of fulltext for searches. After that time, other sources had to be used which did not include fulltext for searches. To eliminate this bias, we linit the search for terms in abstract and title only.
Schematic Overview
TODO
Search Terms
Here are the search terms used in this document. They were provided by the authors, and some adaptations were done by the tsu to adopt them for OpenAlex.
Transformative Change
Show the code
cat(params$s_1_transformative_change)
(
(
(
transformation
OR transition
OR transformative
OR "transformative change"
)
OR (
(
shift
OR change
)
AND (
fundamental
OR deep
OR radical
)
)
)
AND (
socio
OR social
OR politics
OR political
OR governance
OR economic
OR cultural
OR system
OR technological
OR inner
OR personal
OR financial
OR business
)
)
OR (
(
"transformative change"
OR "deliberate transformation"
OR "transformative turn"
OR transition
OR "social-ecological change"
OR "deep change"
OR "fundamental alteration"
OR "profound change"
OR "profound transformation"
OR "radical transformation"
OR "transformational change"
OR "complete change"
OR "complete transformation"
OR "drastic change"
OR "in-depth transformation"
OR "progressive change"
OR "radical alteration"
OR "radical change"
OR "revolutionary change"
OR "significant modification"
OR "total transformation"
OR transition
OR pathway
OR power
OR agency
OR scale
OR leverage
OR context
OR process
OR regime
OR shift
OR views
OR value
OR structure
OR institution
OR deliberate
OR structural
OR fundamental
OR system
OR deep
OR radical
OR profound
OR drastic
OR widespread
OR political
OR economical
OR structur
OR complete
OR progressive
OR revolutionary
OR substantial
OR significant
)
AND (
transformation
OR alteration
OR change
OR turn
OR action
OR transition
OR shift
)
)
Nature
Show the code
#|cat(params$s_1_nature_environment)
biodiversity
OR marine
OR terrestrial
OR forest
OR woodland
OR grassland
OR savanna
OR shrubland
OR peatland
OR ecosystem
OR lake
OR river
OR sea
OR ocean
OR meadow
OR heathland
OR mires
OR bog
OR tundra
OR biosphere
OR desert
OR mountain
OR "natural resource"
OR estuary
OR fjord
OR fauna
OR flora
OR soil
OR "coastal waters"
OR wetland
OR freshwater
OR marshland
OR marches
OR dryland
OR seascape
OR landscape
OR coast
OR "arable land"
OR "agricultural land"
OR "natural environment"
OR "environmental resource"
OR agroforest
OR "agro-forest"
OR plantation
OR "protected areas"
OR chaparral
OR sustainable
OR environment
OR conservation
OR ecosystem
OR nature
OR planet
OR Earth
OR biosphere
OR ecological
OR "socio-ecological"
OR restoration
OR wildlife
OR landscape
OR species
OR bioeconomy
OR "resource system"
OR "coupled system"
OR nature
Assessment Corpus
Show the code
#|cat(params$s_1_tca_corpus)
( biodiversity
OR marine
OR terrestrial
OR forest
OR woodland
OR grassland
OR savanna
OR shrubland
OR peatland
OR ecosystem
OR lake
OR river
OR sea
OR ocean
OR meadow
OR heathland
OR mires
OR bog
OR tundra
OR biosphere
OR desert
OR mountain
OR "natural resource"
OR estuary
OR fjord
OR fauna
OR flora
OR soil
OR "coastal waters"
OR wetland
OR freshwater
OR marshland
OR marches
OR dryland
OR seascape
OR landscape
OR coast
OR "arable land"
OR "agricultural land"
OR "natural environment"
OR "environmental resource"
OR agroforest
OR "agro-forest"
OR plantation
OR "protected areas"
OR chaparral
OR sustainable
OR environment
OR conservation
OR ecosystem
OR nature
OR planet
OR Earth
OR biosphere
OR ecological
OR "socio-ecological"
OR restoration
OR wildlife
OR landscape
OR species
OR bioeconomy
OR "resource system"
OR "coupled system"
OR nature )
AND
( (
(
(
transformation
OR transition
OR transformative
OR "transformative change"
)
OR (
(
shift
OR change
)
AND (
fundamental
OR deep
OR radical
)
)
)
AND (
socio
OR social
OR politics
OR political
OR governance
OR economic
OR cultural
OR system
OR technological
OR inner
OR personal
OR financial
OR business
)
)
OR (
(
"transformative change"
OR "deliberate transformation"
OR "transformative turn"
OR transition
OR "social-ecological change"
OR "deep change"
OR "fundamental alteration"
OR "profound change"
OR "profound transformation"
OR "radical transformation"
OR "transformational change"
OR "complete change"
OR "complete transformation"
OR "drastic change"
OR "in-depth transformation"
OR "progressive change"
OR "radical alteration"
OR "radical change"
OR "revolutionary change"
OR "significant modification"
OR "total transformation"
OR transition
OR pathway
OR power
OR agency
OR scale
OR leverage
OR context
OR process
OR regime
OR shift
OR views
OR value
OR structure
OR institution
OR deliberate
OR structural
OR fundamental
OR system
OR deep
OR radical
OR profound
OR drastic
OR widespread
OR political
OR economical
OR structur
OR complete
OR progressive
OR revolutionary
OR substantial
OR significant
)
AND (
transformation
OR alteration
OR change
OR turn
OR action
OR transition
OR shift
)
) )
Chapter 1
01
Show the code
#|cat(params$s_1_ch1_01)
(
root
OR underlying
OR indirect
)
AND (
driver
OR cause
)
02
Show the code
#|cat(params$s_1_ch1_02)
equity
OR inequity
OR just
OR unjust
OR inequality
OR equality
OR Fair
OR unfair
03
Show the code
#|cat(params$s_1_ch1_03)
scale
OR impact
OR leapfrog
OR transfer
04
Show the code
#|cat(params$s_1_ch1_04)
inclusive
OR participation
OR participatory
OR engagement
OR democratic
OR coproduct
OR transdisc
OR multiactor
OR "multi-actor"
OR integrat
05
Show the code
#|cat(params$s_1_ch1_05)
evaluate
OR reflex
OR reflect
OR monitor
OR adapt
OR learn
06
Show the code
#|cat(params$s_1_ch1_06)
responsib
OR accountable
OR rights
OR steward
OR reciprocity
OR interdependent
OR interdependency
OR (
relation
OR relational
OR plural
OR diverse
OR "sustainability-aligned"
OR (
care
AND (
value
OR ethic
)
)
)
Chapter 2
Show the code
#|cat(params$s_1_ch2)
vision
OR future
OR visionary
OR scenarios
OR imagination
OR imagery
OR creativity
OR desire
OR wish
OR visioning
OR process
OR "participaory process"
OR "deliberate process"
OR polics
OR target
OR view
OR value
OR cosmovision
OR cosmocentric
OR dream
OR fiction
OR hope
OR mission
OR objective
OR story
OR worldview
OR aspiration
OR action
OR plan
OR strategy
OR intention
OR model
OR solution
OR innovation
OR perspective
OR platform
OR collective action
OR cooperation
OR consultation
OR coalition
OR response
OR movement
OR effort
OR initiative
OR activity
OR reaction
OR performance
OR operation
OR effect
OR task
OR project
OR influence
OR moment
OR discourse
OR motivation
OR iteration
OR roadmap
OR agenda
OR project
OR programm
OR government
OR technique
OR inspiration
OR culture
OR universe
OR reality
OR fantasy
OR perception
OR visualization
OR approach
OR image
OR arquetype
OR existence
OR cosmology
OR co - production
OR knowledge
OR dialogue
OR transmission
OR conceptual
OR ceremony
OR relationships
OR respect
OR reciprocity
OR responsibilities
OR solidarity
OR harmony
OR self - determination
OR community
OR spiritual
OR languague
OR territory
OR opportunity
OR sight
OR foresight
OR idea
OR appearance
Chapter 3
01
Show the code
#|cat(params$s_1_ch3_01)
Technology
OR Science
OR "science-society"
OR "science-technology"
OR Solution
02
Show the code
#|cat(params$s_1_ch3_02)
"co-create"
OR "co-creation"
OR solution
OR knowledge
OR system
OR "t-lab"
OR "technology laboratory"
OR education
OR "socio-technical"
03
Show the code
#|cat(params$s_1_ch3_03)
System
OR pathways
OR connect
OR Agroecolog
OR Institutional
OR Institution
OR Government
04
Show the code
#|cat(params$s_1_ch3_04)
inner
OR Personal
OR Religion
OR Love
OR Loving
OR Feelings
OR Stewardship
OR Care
OR Beliefs
OR Belief
OR believe
OR Awareness
OR "Self-Awareness"
05
Show the code
#|cat(params$s_1_ch3_05)
Worldviews
OR Grassroot
OR "Community-based"
OR Indigenous
OR Leadership
OR "Critical Science"
OR Econfeminism
OR "Political Ecology"
OR Power
OR Agency
OR Environment
06
Show the code
#|cat(params$s_1_ch3_06)
Economic
OR "Political Economy"
OR institution
OR govern
OR economy
OR governance
OR government
OR globalization
OR states
OR colonial
OR colonialiasism
OR labour
OR organization
OR organisation
Chapter 4
01
Show the code
#|cat(params$s_1_ch4_01)
(
challenge
OR barrier
OR obstacle
OR hinder
OR hindrance
OR block
OR prevent
OR deter
OR inertia
OR "path dependence"
OR "path dependency"
OR stasis
OR "lock-in"
OR trap
OR habits
OR habitual
OR "status quo"
OR power
OR "limiting factOR"
)
AND (
economic inequality
OR "Wealth concentration"
OR "Socioeconomic inequality"
OR financialization
OR "uneven development"
OR Financialization
OR "Structural adjustment"
OR "Sovereign Debt"
OR inequality
OR "Policy effectiveness"
)
02
Show the code
#|cat(params$s_1_ch4_02)
(
challenge
OR barrier
OR obstacle
OR hinder
OR hindrance
OR block
OR prevent
OR deter
OR inertia
OR "path dependence"
OR "path dependency"
OR stasis
OR "lock-in"
OR trap
OR habits
OR habitual
OR status quo
OR power
OR "limiting factor"
)
AND (
"clean technology"
OR "clean innovation*"
OR "sustainable innovation"
OR "sustainable technological innovation"
)
AND (
"limited access"
OR "limited availability"
OR "lack of access"
OR "unavailability"
)
Chapter 5
Vision
Show the code
#|cat(params$s_1_ch5_vision)
Case
Show the code
#|cat(params$s_1_case)
"case study"
OR case
OR "study area"
OR example
OR evaluation
OR concrete
OR empirical
OR practical
OR initiative
Vision & Case
Topics
OpenAlex assigns topics to each work in a hirarchical manner:
Please see here for more information and here for a complete list of all topics and their corresponding subfields, fields and domains.
Methods
Get and calculate Data from OpenAlex
These data is gathered from OpenAlex directly, not using the downloaded TCA Corpus. The data is used to assess the quality of the TCA Corpus.
The corpus download will be stored in data/pages and the arrow database in data/corpus.
This is not on github!
The corpus can be read by running get_corpus() which o[pens the database so that then it can be fed into a dplyr pipeline. After most dplyr functions, the actual data needs to be collected via collect().
Only then is the actual data read!
Needs to be enabled by setting eval: true in the code block below.
The Sectors definition is based on the subfields assigned to each work by OpenAlex. These were grouped by experts into sectors. See this Google Doc for details.
#|if (!dir.exists(params$corpus_authors_dir)) { con <- duckdb::dbConnect(duckdb::duckdb(), read_only =FALSE)corpus_read(params$corpus_dir) |> arrow::to_duckdb(table_name ="corpus", con = con) |>invisible()paste0("CREATE VIEW corpus_unnest AS ","SELECT ","corpus.id AS work_id, ","corpus.publication_year AS publication_year, ","UNNEST(author).au_id AS au_id, ","UNNEST(author).au_display_name AS au_display_name, ","UNNEST(author).au_orcid AS au_orcid, ","UNNEST(author).author_position AS author_position, ","UNNEST(author).is_corresponding AS is_corresponding, ","UNNEST(author).au_affiliation_raw AS au_affiliation_raw, ","UNNEST(author).institution_id AS institution_id, ","UNNEST(author).institution_display_name AS institution_display_name, ","UNNEST(author).institution_ror AS institution_ror, ","UNNEST(author).institution_country_code AS institution_country_code, ","UNNEST(author).institution_type AS institution_type, ","UNNEST(author).institution_lineage AS institution_lineage ","FROM ","corpus " ) |>dbExecute(conn = con)paste0("COPY ( ","SELECT * FROM corpus_unnest ",") TO '", params$corpus_authors_dir, "' ","(FORMAT PARQUET, COMPRESSION 'SNAPPY', PARTITION_BY 'publication_year')" ) |>dbExecute(conn = con) duckdb::dbDisconnect(con, shutdown =TRUE)}
Here we show the number of hits for the key papers in the different individual corpi. The columns represent the different search terms as defined in Section 2.2.
Each column is a different search term, and each row consists of the key papers of a specific chapter and the author who provided the key papers. The number is the number of key papers occurring in the Individual Corpus.
The red line is the cumulative proportion of publications, the blue line the cumulative proportion of all of the Op[enAlex corpus. Both use the secondeary (red) axis.
Warning in instance$preRenderHook(instance): It seems your data is too big for
client-side DataTables. You may consider server-side processing:
https://rstudio.github.io/DT/server.html
The file strategies_options.txt contains the terms for the different strategies and options.
I will now iterate through all of them and identify the number of hits per individual search term. This can be used as a result in itself in interpreting the importance of each term as well as to shorten the search term to be able to use it together with the TCA search term.
Show the code
#|if (!file.exists(file.path("data", "tca_corpus", "strategies_options.rds"))) {# Read the lines from the file sts <-readLines("input/tca_corpus/search terms/strategies_options.txt")# Remove empty or NA lines or Main header ("# ") sts <- sts[!is.na(sts) &nchar(sts) >0] sts <-grep("^# ", sts, invert =TRUE, value =TRUE)# Create a vector that indicates where each new first-level element should start split_points_level1 <-cumsum(grepl("^## \\(", sts))# Split the vector into a list list_sts_level1 <-split(sts, split_points_level1)# For each first-level element, split into second-level elements list_sts_level2 <-lapply(list_sts_level1, function(x) { split_points_level2 <-cumsum(grepl("^###", x))split(x, split_points_level2) })# Remove the lines with "## (" and "###" from each element of the list sts_split <-lapply( list_sts_level2,function(x) {lapply( x,function(y) { res <- y[!grepl("^## \\(|^###", y)]if (length(res) ==0) { res <-NULL }return(res) } ) } ) sts_split <-lapply( sts_split,function(sts) { i <-sapply( sts, length ) >0return(sts[i]) } )# Extract the names for the first-level list names_level1 <-gsub("^## \\(|\\)$", "", sts[grepl("^## \\(", sts)])# Extract the names for the second-level lists names_level2 <-lapply(list_sts_level1, function(x) gsub("^### |\\)$", "", x[grepl("^###", x)]))names(names_level2) <- names_level1# Assign the names to the first-level listnames(sts_split) <- names_level1 sts_split <-Map(setNames, sts_split, names_level2) result <-lapply( sts_split,function(sts) {lapply( sts,function(st) { result <-list() result$term <-paste(st, collapse =" ") result$count <-NA result$years <-NA result$assess_search_terms <-NAtry( { result$count <- openalexR::oa_fetch(title_and_abstract.search = IPBES.R::compact(paste0("(", params$s_1_tca_corpus, ") AND (", result$term, ")")),count_only =TRUE,output ="list",verbose =TRUE )$count result$years <- openalexR::oa_fetch(title_and_abstract.search = IPBES.R::compact(paste0("(", params$s_1_tca_corpus, ") AND (", result$term, ")")),group_by ="publication_year",output ="dataframe",verbose =TRUE ) },silent =TRUE ) result$assess_search_terms <-assess_search_term(st = st,remove =" OR$",excl_others =FALSE,mc.cores =8 ) |> dplyr::arrange(desc(count))return(result) } ) } )saveRDS(result, file.path("data", "tca_corpus", "strategies_options.rds"))}
@report{krug2024,
author = {Krug, Rainer M.},
title = {Data {Management} {Report} {Transformative} {Change}
{Assessment} {Corpus} - {SOD}},
date = {2024-04-17},
doi = {10.5281/zenodo.10251349},
langid = {en},
abstract = {The literature search for the assessment corpus was
conducted using search terms provided by the experts and refined in
co-operation with the Knowldge and Data task force. The search was
conducted using {[}OpenAlex{]}(https://openalex.org), scripted from
{[}R{]}(https://cran.r-project.org) to use the
{[}API{]}(https://docs.openalex.org). Search terms for the following
searches were defined: **Transformative Change**, **Nature /
Environment** and **additional search terms for individual chapters
and sub-chapters** To assess the quality of the corpus, sets of
key-papers were selected by the experts to verify if these are in
the corpus. These key-papers were selected per chapter / sub-chapter
to ensure that the corpus is representative of each chapter.}
}
For attribution, please cite this work as:
Krug, Rainer M. 2024. “Data Management Report Transformative
Change Assessment Corpus - SOD.”Report Transformative Change
Assessment Corpus. https://doi.org/10.5281/zenodo.10251349.
